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1.  Introduction 

Let  { Pt :  0  <  t  <  00}  be  a  strongly  continuous  one-parameter  semigroup  of 
transition  operators  on  the  Banach  space  A  of  absolutely  convergent  series, 
reducing  to  the  identity  at  t  =  0,  with  matrix  representation 

(1)  (Ptx)j  =  E  XtVv(t),  ( j  =  1,  2,  •  •  •), 

i 

so  that  in  {pa(- ) :  i,  j  =  1,  2,  •  •  •}  we  have  a  standard  family  of  Markov  transi¬ 
tion  functions  on  [0,  qo)  in  the  terminology  of  K.  L.  Chung  [1].  In  this  and  in 
the  succeeding  papers  [5],  [6]  we  shall  be  interested  in  three  loosely  related  ques¬ 
tions  : 

(i)  the  analyticity  or  otherwise  of  the  functions  Pa(-); 

(ii)  the  identification  of  quasi-analytic  classes  of  such  functions; 

(iii)  the  possibility  of  extending  the  Markov  semigroup  {Pt :  0  <  t  <  °o }  to  a 
strongly  continuous  group  {Pt:  —  <»  <  t  <  00}  of  bounded  linear  operators  on  A- 

The  present  paper  is  concerned  with  the  last  of  these  three  topics,  and  consists 
largely  of  conjectures  and  scraps  of  evidence  about  them.  Some  further  evidence 
will  be  found  in  the  accompanying  paper  by  Miss  J.  M.  O.  Speakman  [7].  If 
our  remarks  lead  others  to  solve  the  problems  posed,  we  shall  be  delighted. 

2.  Property  ( U )  and  property  (G) 

It  will  be  helpful  to  make  the  following  definitions. 

Definition  1.  A  Markov  semigroup  { Pt :  0  <  t  <  00}  will  be  said  to  have 
property  (U)  when  any  one  of  the  following  equivalent  conditions  is  satisfied: 

(1/1) :  puit)  — » 1  as  t  — >  0,  uniformly  with  regard  to  i; 

(C/2):  ||P*  —  7||  — >  0  as  t  —>  0‘, 

(C/3):  Pt  =  exp  (At),  where  A  is  a  bounded  operator; 

(C/4):  sup  Qi  <  cc ,  where  q,  =  —  p«(0). 

The  equivalence  of  (C/1)  and  (C/2)  is  due  to  the  fact  that 

(2)  || Pt  -  I\\  =2  sup  (1  -  pa(t)). 

i 

The  equivalence  of  (C/2)  and  (C/3)  is  a  standard  result  in  the  theory  of  such 
semigroups  ([4],  theorem  9.6.1).  The  equivalence  of  (C/123)  and  (C/4)  follows 
from  the  fact  that 

(3)  1  —  pu(t)  <  1  —  exp  (— qd)  <  qd, 

165 


166 


FIFTH  BERKELEY  SYMPOSIUM:  KENDALL 


and  from  the  consequence  g*  =  —An  of  (C/3).  Property  (U)  is  so  named  because 
it  is  plainly  a  ‘uniformity’  property;  Markov  semigroups  with  property  (U) 
are  sometimes  called  * q-bounded .’ 

We  note  in  passing  that  the  g»’ s  always  exist  and  can  have  values  between  0 
and  +oo  inclusive.  The  off-diagonal  derivatives  =  plj(0)  (i  ^  j)  also  exist  and 
satisfy  0  <  g,y  <  oo .  In  the  ^-bounded  case  infinite  values  for  the  qf s  are  of 
course  excluded,  and  the  matrix  Q  =  ( q if),  with  qu  =  —qif  can  then  be  identified 
with  +  at  (C/3). 

It  is  clear  that  g-bounded  Markov  semigroups  can  always  be  extended  to 
uniformly  continuous  groups  {Pt:  —  oo  <  t  <  oo}  by  taking  the  equation  at 
(C/3)  to  be  the  definition  of  Pt  when  t  <  0,  and  in  particular  this  is  true  when 
the  number  of  states  is  finite. 

It  is  worth  remarking  that  the  adjoined  operators  Pt  with  t  <  0  will  never 
(save  in  a  trivial  case)  be  transition  operators.  This  follows  from  the  fact  (which 
I  owe  to  P.  Whittle)  that  if  P  and  Q  are  transition  operators  and  if  PQ  =  QP  =  I, 
then  both  P  and  Q  must  be  permutations.  Thus  if  P_r  is  a  transition  operator  for 
some  positive  r,  then  PT  must  be  a  permutation.  However  it  has  a  strictly  posi¬ 
tive  diagonal,  so  it  must  be  7.  From  this  it  follows  that  P„T  =  I  for  all  integers  n, 
and  then  it  becomes  evident  that  the  whole  semigroup  must  reduce  to  the  iden¬ 
tity. 

Whittle’s  lemma  can  be  proved  as  follows.  Let  j  be  any  state;  then  ( QP)a  = 
8jj  >  0,  and  hence  P„  >  0  for  at  least  one  state  i.  For  such  an  i  we  must  have 
( PQ)ik  —  8ilc  =  0,  save  when  k  =  i,  so  that  Qjk  =  0,  except  when  k  =  i.  From 
this  it  is  clear  that  Pa  >  0  for  exactly  one  i.  Thus  each  row  of  Q  and  each  col¬ 
umn  of  P  contains  exactly  one  nonzero  element.  The  result  now  follows  from 
the  symmetry  of  the  data. 

It  is  important  to  notice  that  (C/)  is  a  property  of  the  system  as  a  whole, 
and  that  it  cannot  be  defined  in  terms  of  the  irreducible  classes  of  states,  if  such 
exist.  This  is  obvious  from  (C/4). 

We  now  make  a  second  definition. 

Definition  2.  A  Markov  semigroup  will  be  said  to  have  property  (G)  when 
it  is  possible  to  define  bounded  linear  operators  Pt  for  all  t  <  0  such  that 
(P<:  —oo  <  t  <  oo }  is  a  strongly  continuous  group. 

Obviously  ( U )  implies  ( G );  the  converse  might  be  conjectured  to  be  true,  but 
whether  this  is  so  or  not  appears  to  be  an  open  question. 

Like  (C/),  (G)  is  not  a  class  property.  This  will  be  made  clear  in  the  following 
section  of  the  paper,  where  we  shall  exhibit  some  direct  sums  of  finite-state 
Markov  semigroups  which,  in  contrast  to  their  summands,  have  neither  the 
property  (C/)  nor  (G). 

3.  Remarks  about  the  relation  between  (C/)  and  (G),  and  some  examples 

To  illustrate  one  important  feature  of  the  problem,  it  is  useful  to  consider 
the  simple  birth  process  with  unit  birth  rate.  For  this,  pa(t)  =  0  when  1  <  j  <  i, 
and 
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(4) 


when  1  <  i  <  j. 


The  matrix  Q  is  given  here  by  qu  =  —i,  qiti+ 1  =  -\-i,  q a  =  0  otherwise,  so  that 
the  system  is  certainly  not  ^-bounded.  If  ( G )  is  to  hold,  then  Pt  for  t  =  —  r  <  0 
must  be  PT-1,  and  the  upper  triangular  character  of  PT  ensures  that  the  elements 
of  Pt  are  uniquely  determined  by  the  finite  linear  equations  expressing  the  fact 
that  PtPT  =  I ■  It  follows  in  this  way  that  the  components  of  Pt  are  given  by 
the  same  analytical  formulae  when  t  <  0  as  when  t  >  0. 

But  now  we  observe  that 


(5)  £  \Vij(f)\  =  (2e~r  —  l)_i  when  0  <  r  <  log  2, 

i 

and  that  the  series  diverges  when  r  >  log  2.  Thus 

(6)  1 1 P*||  =  sup  £  |pu(OI  =  00  for  all  t  <  0, 

i  3 

and  so  the  operators  Pt(t  <  0)  are  not  bounded.  Thus  (G)  does  not  hold. 

An  elementary  theorem  about  semigroups  shows  that  in  testing  for  ((?), 
only  one  value  of  t  <  0  need  be  examined. 

Theorem  1.  Property  ( G )  holds  if  and  only  if  Pt  has  a  hounded  inverse  for 
some  one  ( and  then  for  all)  t  >  0. 

This  is  theorem  16.3.6  of  [4];  for  completeness  we  sketch  a  proof.  In  any 
Banach  algebra,  if  T  is  boundedly  invertible,  then  so  is  any  R  for  which  RA  = 
I  =  BR;  thus,  if  PT  is  invertible  for  some  one  r  >  0,  then  so  is  Pt  for  0  <  t  <  r, 
and  therefore  so  is  Pnt  for  all  positive  integers  n,  so  that  Pt  is  invertible  for  all 
t  >  0.  Putting  P_t  =  {Pt)~l  for  t  >  0  yields  a  group  { Pt :  —«>  <<<<»},  and 
strong  continuity  then  follows  from  the  inequalities 

(7)  HP-*  -  *||  =  || Pa-t(P-aX  ~  P^ax) || 

<  IIP-.II  IIP.(P-z)  -  (P-z)ll 

<  ||P«(P^t)  -  (P_„z)||, 

where  0  <  t  <  a  (fixed). 

It  is  not  difficult  to  find  wide  classes  of  Markov  semigroups  within  which 
( U )  =  ( G ).  For  example,  consider  the  Cohen  semigroup  {P,°:  0  <  t  <  <x>} 
derived  from  a  given  Markov  semigroup  { Pt :  0  <  t  <  oo)  by  the  following 
construction  [2],  [3]: 

fPo®  =/, 

(8)  J  i  /*°° 

j  Ppx  =  Yyj  Jo  e~uul~lPux  du,  (0  <  t  <  oo ). 


It  is  easily  verified  that  each  Pt°  is  a  transition  operator,  and  the  new  operators 
form  a  semigroup  in  virtue  of  Dirichlet’s  integral  formula.  It  is  strongly  con¬ 
tinuous  because 


(9)  || P®x  —  x\\  =  r(£)_1  Jq  e~uul~l  du  PvAx  dv  <  i||Ax|[, 
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if  t  >  0  and  if  x  lies  in  the  domain  of  the  infinitesimal  generator  A.  This  shows 
that  jj Pt°x  —  x\\  — » 0  when  t  — ►  0  for  all  such  x,  and  then  for  every  x  by  an  appeal 
to  the  Banach-Steinhaus  theorem. 

Now  Pi  =  Ri  =  (/  —  A)-1,  where  { R\ :  0  <  X  <  <*>}  is  the  family  of 
resolvent  operators  for  the  original  semigroup.  From  this  point  of  view, 
{P,°  :0<£<<»}isa  semigroup  of  fractional  powers  of  Ri.  In  view  of  theorem  1> 
we  know  that  the  derived  semigroup  will  have  property  ( G )  if  and  only  if  R1 
has  a  bounded  inverse.  This,  however,  is  equivalent  to  requiring  the  original 
semigroup  to  have  a  bounded  infinitesimal  generator  A,  when  by  (U 3)  it 
will  be  (/-bounded.  We  should  then  have 


(10)  IIP,®  -  7||  <  r«)-*  J’ v.  -  z||  du  =  0(1),  (i  - 0), 

and  hence,  arrive  at  proposition  1. 

Proposition  1.  A  Cohen  semigroup  (Pt°:  0  <  t  <  <»}  has  property  (G)  if 
and  only  if  it  has  property  (U). 

We  have  remarked  that  ( U )  is  not  a  class  property,  and  that  the  same  is 
true  of  ( G ).  Thus,  it  is  reasonable  to  look  at  Markov  semigroups  which  are  built 
up  out  of  simpler  ones  by  a  direct  sum  construction.  Let  us  write 


(11) 


//3  +  ae  pt  a(l  —  e  pt)\ 
\/3(l  —  e~pt )  a  +  Pe~pt  / 


where  a,  p,  and  p  are  nonnegative  and  a  +  @  =  1.  These  matrices  represent  the 
most  general  two-state  Markov  semigroup,  which  of  course  has  both  properties 
(U)  and  (G),  and 

(12)  ||P“_0/||  =  1  +  2  max  (a,  p){e<"  -  1),  (r  >  0). 


If  we  now  form  the  direct  sum  of  a  sequence  of  such  semigroups  with  parame¬ 
ters  ( ak ,  fik,  Ph)(k  =  1,  2,  •  •  •  ,)  it  will  be  seen  that  the  semigroup  thus  constructed 
will  in  any  case  be  strongly  continuous,  and  that  it  will  have  property  (U)  if 
and  only  if 


(13) 


sup  max  (a*,  pk)pk  <  °o , 

k 


whereas  it  will  have  property  ( G )  if  and  only  if 


(14)  sup  max  ( ak ,  pk){epk  —  1)  <  <». 

k 

Now  |  <  max  ( ak ,  fik)  <  1,  hence  the  two  boundedness  conditions  are  equiv¬ 
alent.  Thus  we  have  proposition  2. 

Proposition  2.  A  direct  sum  of  two-state  Markov  semigroups  has  property  ( G ) 
if  and  only  if  it  has  property  (JJ). 

It  would  be  desirable  to  extend  this  result  to  cover  the  direct  sums  of  arbitrary 
finite-state  semigroups,  or  more  generally  to  direct  sums  of  (/-bounded  semi¬ 
groups.  For  a  contribution  to  this  problem  see  section  2  of  [7]. 

The  following  two  observations  (which  I  owe  to  D.  Williams)  deny  the 
property  (G)-but-not-(t/)  to  still  further  classes  of  Markov  semigroups.  First, 
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suppose  that  {Pt:  0  <  t  <  00}  is  measurable  in  the  uniform  sense.  This  re¬ 
quires  that  there  be  a  sequence  of  measurable  countably-valued  operator  func¬ 
tions  of  t  which  converge  in  the  uniform  sense  to  Pt  for  almost  all  t.  From  the¬ 
orem  9.3.1  of  [4],  it  then  follows  that  Pt  depends  continuously  on  t,  in  the  uni¬ 
form  sense,  for  t  >  0.  If  (G)  holds,  the  inequalities 

(15)  ||P*  -  /||  <  \\P-t\\  ||P**  -  Pi||  =  o(l)  as  h->  0 

(for  fixed  t  >  0),  then  imply  that  (U)  holds.  We  therefore  have  the  next  proposi¬ 
tion. 

Proposition  3  (Williams).  A  uniformly  measurable  Markov  semigroup  has 
property  ( G )  if  and  only  if  it  has  property  (U).  In  particular  this  is  true  of  Markov 
semigroups  uniformly  continuous  for  t  >  0. 

It  will  be  noticed  that  uniform  continuity  at  any  one  t  >  0  is  enough  to  force 
the  conclusion.  Uniform  continuity  often  arises  as  a  result  of  compactness,  but 
the  following  result  is  best  established  directly,  although  it  could  be  exhibited 
as  a  corollary  to  proposition  3. 

Proposition  4  (Williams).  If  the  Markov  semigroup  {Pt:  0  <  t  <  00}  has  a 
resolvent  operator  R\  which  is  compact  for  some  one,  and  then  for  all,  X  >  0, 
then  it  has  property  (G)  if  and  only  if  it  has  property  ( U ),  and  the  state  space  must 
then  be  finite. 

This  depends  on  a  surprising  theorem  [8]  of  Williams  according  to  which  the 
compactness  of  R\  implies  that  of  Pt  for  every  t  >  0.  If  (G)  holds,  therefore,  we 
shall  have  a  compact  identity  I  =  P_tPf,  and  so  the  state  space  must  be  finite 
and  ( U )  must  hold. 

These  propositions  help  to  delimit  the  region  within  which  one  should  look 
for  counter  examples  to  the  conjecture  that  (U)  =  (G). 

4.  The  (r,  7>-diagram 

Theorem  1  shows  that  a  Markov  semigroup  will  have  the  property  (G)  if  it 
has  the  property  defined  below. 

Definition  3.  A  Markov  semigroup  will  be  said  to  have  property  ( F )  when 
there  is  a  positive  value  of  t  for  which  f(t)  =  ||P«  —  7||  <  1. 

Thus  (U)  =>  (P)  =>  (G).  Let  class  A  consist  of  those  Markov  semigroups  which 
have  property  (P)  but  not  property  ( U ),  and  let  class  B  consist  of  those  Markov 
semigroups  which  have  property  ( G )  but  not  property  (P).  If  it  is  true  that 
(U)  =  (G),  then  the  classes  A  and  B  will  both  be  vacuous. 

It  is  useful  to  write 

(16)  g(t)  =  inf  pa(t),  (0  <  t  <  00), 

i 

because  we  have 

(17)  m  =  2(1  -  g(t)),  g(t)  =  1  -  /(«)/ 2. 

Thus  the  (P)  semigroups  are  those  for  which  g(t)  >  \  for  some  t  >  0.  (We  must 
exclude  t  =  0  because  in  all  cases  g( 0)  =  1.)  Miss  Speakman  [7]  has  shown  that 
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a  direct  sum  of  (U)  semigroups  which  does  not  itself  have  property  (U)  must 
be  such  that  g(t )  <  §  for  all  t  >  0.  Thus,  if  class  B  could  be  shown  to  be  empty, 
we  could  strengthen  proposition  2  to  include  all  direct  sums  of  ( U )  semigroups. 
Let  us  put 

(18)  T  =  lim  sup  g(t),  y  =  lim  inf  g(t). 

*-►0  t->o 

Then  the  ( U )  semigroups  are  precisely  those  for  which  (r,  y)  =  (1,  1).  For  the 
direct  sum  of  two-state  Markov  semigroups  considered  in  proposition  2,  with 
ak  =  a,  fik  =  fi,  and  p*  =  k  (an  example  suggested  by  J.  F.  C.  Kingman),  we 
have  r  =  y  =  min  ( a ,  fi),  and  so  we  can  have  (r,  y)  =  (c,  c)  where  c  has  any 


Figure  1 

The  (r,  7)  diagram 
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value  in  the  closed  interval  [0,  §].  When  r  =  y  there  are  no  other  possibilities. 
This  is  a  consequence  of  the  following  unpublished  result  of  G.  E.  H.  Reuter. 

Theorem  2  (Reuter).  If  y  >  h,  then  property  (U)  holds. 

Instead  of  giving  Reuter’s  proof  of  theorem  2,  we  shall  modify  it  slightly  so 
as  to  give  rather  more  information.  We  shall  prove  the  following  theorem. 

Theorem  3.  For  every  Markov  semigroup,  the  pair  (r,  7)  must  he  (1,1),  or 
must  correspond  to  a  point  lying  in  the  closed  shaded  region  in  figure  1 ;  that  is,  the 
only  possibilities  are 

(a)  r  =  7  =  1;  y _ 

(b)  r  >  I  and  0  <  7  <  {1  -  v(2r  -  l)}/2; 

(c)  0  <  r  <  \  and  0  <  7  <  r. 

We  do  not  assert  that  all  such  pairs  (r,  7)  can  in  fact  be  realized,  although  we 
have  seen  that  this  is  true  so  far  as  pairs  of  the  form  (r,  7)  =  (c,  c)  are  concerned. 
In  an  early  stage  of  this  investigation  it  seemed  possible  that  Y  and  7  would 
always  be  equal,  but  Miss  Speakman  [7]  has  shown  that  this  is  not  so;  in  fact, 
it  is  now  clear  from  her  work  that  the  region  actually  occupied  by  the  pairs 
(r,  7)  is  two-dimensional,  and  is  definitely  smaller  than  that  permitted  by 
theorem  3.  In  an  attempt  to  delimit  it  more  exactly  we  have  called  in  automatic 
computing  aids,  and  a  provisional  account  of  this  work  will  be  found  in  [6] 
and  [7]. 

It  will  be  noticed  that  Reuter’s  theorem  follows  from  theorem  3  by  projection 
onto  the  7-axis.  Although  the  maximum  allowable  region  in  the  (r,  7)-plane 
projects  onto  the  whole  interval  [0,  1]  on  the  T-axis,  we  do  not  know  whether 
all  of  this  is  actually  attained;  in  fact,  we  know  of  no  example  with  \  <  Y  <  1. 
(After  this  was  written,  Miss  Speakman  [7]  proved  that  parts  of  the  interval 
[0,  1]  are  inaccessible  to  T.)  If  such  an  example  could  be  found,  then  we  should 
have  discovered  a  class  A  semigroup,  and  we  should  know  that  property  ( F ), 
and  so  also  property  (G),  was  not  equivalent  to  (U). 

Proof  of  theorem  3.  Let  {Pt:  0  <  t  <  00}  be  any  Markov  semigroup. 


From  the  identities 

(19) 

Pt+S  -  I  =  P.(P,  -  /)  +  (P.  -  I) 

and 

(20) 

2 {pt  -  i)  =  (p„  -i)-  (pt  -  iy, 

we  find  that 

(21) 

f(t  +  s)  <  f(t)  +  f(s) 

and 

(22) 

2/(0  <  f(2t)  +  {my, 

so  that 

(23) 

g(t)  +  g(s)  <  1  +  g(t  +  s) 

and 

(24) 

g(2t)  <  1  -  2g(t)  +  2{g(t)}*. 
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Note  that  the  first  ^-inequality  also  gives  g(2t)  >  2 g(t)  —  1.  We  must  have 
0  <  g(t)  <  1  for  all  t.  Suppose  that  g(r)  =  c  >  %  for  some  r  >  0.  Put  tn  =  r/2n. 
From  (24)  we  find  that  either 

(25)  g(U)  >  {1  +  V(2c  -  l)}/2, 
or 

(26)  gif ,)  <  {1  -  V(2c  -  l)}/2. 

If  the  first  alternative  holds,  then  g{tf)  >  \  and  we  can  continue  the  argument. 
Thus  either 

(27)  g(tK)  >  (1  +  (2c  -  l)2~"}/2  for  all  n=  1,  2,  •  •  •  , 
or 

(28)  g(tn)  <  (1  —  (2c  —  l)2-"}/2  for  some  n  >  1. 

Suppose  the  first  alternative  holds.  Then  if  we  put 

(29)  a  =  (2r)-'Iog53^1> 

so  that  a  >  0,  and  is  finite,  we  shall  have  g(tn )  >  1  —  atn  for  all  n  =  1,  2,  •  •  •  ; 
hence,  /(£„)  <  2af„  for  all  n.  But/(-)  is  subadditive;  therefore,  fit)  <  2 at  when¬ 
ever  t  =  pr  where  p  is  a  rational  with  binary  denominator.  For  such  values  of  t 
we  therefore  must  have  g(t)  >  1  —  at,  and  pu{t)  >  1  —  at  for  all  states  i.  But 
Pu(-)  is  continuous  for  each  i,  and  so  the  last  inequality  must  hold  for  all  t  >  0, 
whence  every  ?,<«<«»,  and  the  semigroup  is  g-bounded.  Thus  the  first 
alternative  holds  only  if  the  semigroup  has  property  (U). 

If  the  second  alternative  holds,  then  we  cannot  identify  the  value  of  n  for 
which  (28)  is  true,  but  at  least  for  that  value  of  n  we  must  have 

(30)  g(tn)  <  {1  -  V(2c-  l)}/2; 

hence,  we  arrive  at  the  following  lemma. 

Lemma.  If  a  Markov  semigroup  does  not  have  property  ( U ),  and  if  g(r)  >  \ 
for  some  r  >  0,  then 

(31)  5(0  <  {1  -  V(25(t)  -  l)}/2 
for  some  t  =  r/ 2",  (n  =  1,  2,  •  •  •). 

We  can  now  prove  theorem  3.  We  simply  have  to  show  that,  if  \  <  T  <  1  for 
some  non- (U)  semigroup,  then  y  cannot  exceed  the  upper  bound  stated  at  (b). 
In  these  circumstances  we  can  find  a  sequence  r*  j  0  at  which  girf)  =  Cic—>T, 
with  every  ck  >  We  can  therefore,  by  the  lemma,  find  another  sequence 
tk  — >  0  such  that 

(32)  g(t„)  <  {1  -  V (2ct  -  l)}/2  — »  {1  —  V(2r  -  Ij}/2, 

and  so  y  cannot  exceed  the  limit  on  the  right-hand  side. 
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